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ABSTRACT 


■> 

This  research  is  intended  to  improve  the  author's  previous  algorithm 
for  solving  an  optimization  problem  connected  with  the  determination  of 
the  composition  of  a War  Readiness  Spares  Kit.  The  problem  was  formulat- 
ed as  a discrete  minimization  model  with  two  nonlinear  constraint 
functions,  of  which  one  is  nonseparable. 

The  solution  algorithm  is  modified  in  several  aspects  including 
selection  of  a good  initial  kit  composition,  improvements  in  convergence 
toward  a global  optimum  and  refinements  in  programming  techniques.  A 
branch-and-bound  technique  and  a univariate  search  method  are  incorporated 
into  the  algorithm  and  a numerical  example  is  given. 

Computational  results  show  that  the  revised  algorithm  is  improved 
in  computational  efficiency.  However,  some  factors  must  be  considered  in 
order  to  enhance  the  capability  of  the  algorithm  for  solving  practical 
problems. 
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I.  INTRODUCTION 


This  research  project  is  a sequel  to  the  author's  previous  work  [1] 
that  developed  an  algorithm  for  solving  an  optimization  problem  connected 
with  the  determination  of  the  composition  of  a War  Readiness  Spares  Kit 
(WRSK).  The  problem  was  formulated  as  a cost  minimization  model  with  non- 
linear constraints  in  which  the  decision  variables  are  required  to  be 
integers. 

The  model  and  its  variants  are  rather  appealing  to  the  optimization 
theoreticians  as  well  as  to  the  logistics  practitioners.  Theoretically, 
they  belong  to  a class  of  discrete  optimization  problems  which  at  present 
have  no  efficient  solution  algorithms.  In  application,  this  model  can 
represent  many  important  concrete  problems  in  the  logistics  area  [2,3]. 

The  purpose  of  this  research  is  to  improve  the  efficiency  of  the 
rudimentary  algorithm  which  was  previously  proposed  by  the  author  [1]. 

The  problem  under  study  will  be  briefly  described  and  its  associated 
optimization  model  will  be  derived  in  the  next  two  sections.  Section  IV 
will  describe  other  approaches  to  this  problem  and  will  review  the  pre- 
viously proposed  solution  algorithm  to  our  optimization  model  [1].  An 
improved  version  of  the  algorithm  will  be  presented  and  illustrated  by  a 
numerical  example  in  Section  V.  Finally,  computational  results  and  conclu- 
sions will  be  reported  in  Section  VI,  and  a listing  of  FORTRAN  programs  for 
the  algorithm  included  as  an  appendix. 
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II.  PROBLEM  STATEMENT 


A War  Readiness  Spares  Kit  for  an  aircraft  squadron  consists  of 
selected  spare  parts  required  to  sustain  its  wartime  activities  during 
the  period  when  the  squadron  is  operating  under  a "remove  and  replace" 
maintenance  concept.  Any  items  that  fail  in  the  aircraft  are  removed  from 
it  and  replaced  with  spare  items  from  the  kit  or  with  serviceable  items 
from  another  "down"  aircraft.  These  down  aircraft  are  referred  to  as 
NORS  (Not  Operationally  Ready,  Supply)  aircraft.  The  problem  is  to  deter- 
mine the  quantity  for  each  selected  item  to  be  placed  in  the  kit  so  that 
the  total  cost  per  kit  is  minimized  while  maintaining  a desirable  level 
of  unit  readiness. 

Two  criteria  are  currently  in  use  for  measuring  unit  readiness: 

(1)  the  expected  (or  average)  number  of  NORS  aircraft  and  (2'  the  total 
of  the  expected  shortages  for  all  items.  The  expected  NORS  seems  to  be 
more  logical  [4]  in  terms  of  measuring  the  readiness  of  a squadron, 
whereas  the  total  expected  number  of  shortages  is  easier  in  computation 
and  is  a traditional  method  used  by  Air  Force  supply  personnel.  Both 
measures  of  readiness  are  concurrently  used  in  practice.  However,  con- 
fusion may  arise  whenever  the  performance  of  a kit  is  satisfactory  in  one 
measure  and  unsatisfactory  in  the  other.  As  a result,  a combined  measure 
has  been  proposed  [1].  The  optimization  model  derived  in  this  study  is 
based  on  this  measure. 
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III.  AN  OPTIMIZATION  MODEL 


The  WRSK  problem  can  be  formulated  as  the  following  optimization 
model:  Given  certain  acceptable  levels  of  expected  number  of  NORS  air- 
craft (b^)  and  the  total  expected  shortages  for  all  items  (b2),  find  a kit 
composition,  X = (x-j,  x2,  x^ , xr)  such  that  the  total  cost  is 
minimized.  Mathematically,  the  model  is  one  of  a class  of  discrete 
resource  allocation  problems; 

r 

Minimize  Z(X)  = l c.x, 
i = l 1 1 

Subject  to  E-j  (X)  £ b^ 

E2(X)<b2  (1) 

x^  0 and  integer 

where: 

x.j  = quantity  of  a line  item,  i,  to  be  placed  in  the  kit 
c.j  = unit  cost  of  line  item  i 

E,(X)  = computed  value  of  the  expected  number  of  NORS  aircraft  at 
composition  level  X 

E? ( X ) = computed  value  of  the  total  expected  shortages  at  composition 
level  X 

The  model  is  an  n-dimensional  discrete  optimization  problem  with  two 
nonlinear  constraints.  Logically,  the  constraint  functions  must  be  de- 
creased as  the  number  of  units  in  the  kit  increase.  The  decreasing  prop- 
erty will  become  more  evident  when  the  functions  of  E-j(X)  and  E2(X)  are 
algebraically  defined. 

Assumptions 

The  following  assumptions  are  made  in  the  derivation  of  E^(X)  and 

E2(X): 
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4 


1.  The  number  of  failures  for  each  line  item  within  any  time  in- 


terval is  a random  variable  which  follows  a Poisson  distribution. 


2.  When  a failure  (or  demand)  of  a part  cannot  be  filled  from  the 


kit,  then  it  is  satisfied  by  removing  the  needed  part,  if 


available,  from  an  already  NORS  aircraft.  Thus,  parts  shortages 


are  consolidated  on  as  few  aircraft  as  possible. 


3.  All  down  aircraft  have  approximately  the  same  number  of  ser- 


viceable items. 


4.  Every  item  placed  in  the  kit  is  essential  to  the  operation  of 


an  aircraft.  Failure  of  any  such  item  could  cause  a NORS  air- 


craft. 


5.  All  items  are  independent  in  the  sense  that  the  failure  of  any 


item  does  not  affect  the  failure  of  any  other  item. 


Expected  Number  of  NORS  Aircraft 


Under  assumption  1,  the  number  of  failures  which  occur  in  a unit 


time  follows  the  Poisson  distribution  with  mean  X.  If  q(j)  is  the  prob- 


ability of  exactly  j failures  in  a unit  time,  then: 


Xj  e'X 


and  the  probability  of  i or  fewer  failures  is: 


Q(D  = l 


j=0  ^ 


Let  n be  the  number  of  down  aircraft  for  lack  of  essential  parts 


and  ai  be  the  quantity  of  item  i available  in  each  aircraft.  If  item  i 
has  xi  spares  in  the  kit,  then  under  assumptions  2 and  3,  there  are  a 
total  of  (xi  + na . ) spares  available  for  replacement  of  item  i. 
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Since  each  item  is  essential  to  the  operation  of  aircraft  (assumption 
4)  and  all  items  are  independent  (assumption  5),  the  probability  of  n or 
less  NORS  aircraft  is: 


r 

II  Q.(x.  + na. ) where  r = number  of  item  types 
i=l  11  1 

and  the  probability  of  exactly  n NORS  aircraft  is: 


r r 

n Qj (x • + na.)  - n Q - ( X - + (n-l)a.) 
i=l  11  1 i=l  1 1 1 


Then  by  definition,  the  expected  number  of  NORS  aircraft  in  a squadron  of 
N aircraft  is: 


Nr  r 

E,(X)  = In[n  Q,(x.  + na,)  - n Q - (x . + (n-l)a.)]  (2) 

1 n=0  i=l  1 1 1 i=l  1 1 1 


Note  that: 


n Q,(x.  + N a.)  = 1 
i=l  1 1 1 


Expanding  and  rearranging  (2),  we  obtain  the  following  expression: 
N-l  r 

Ei (X)  - N - Z n Q,(x.  + na.) 

1 n=0  i=l  1 1 1 


(3) 


where: 


xi+nai 


Q.(x.  + na.)  = Z q. 
1 1 j=l  J 


A function  F of  several  variables,  x^ , x^,  ....  xr  is  called  separa'lf; 
if  there  are  n functions,  f ^ , f£,  fr  of  one  variable  each,  such  that 

F(X>-  X2 V ’ l f1(Xi> 

A very  pleasant  property  of  separable  functions  is  that  they  may  be 
optimized  one  variable  at  a time.  This  property  can  lead  to  considerable 
savings  in  computational  time;  in  fact,  it  can  make  the  difference  between 
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a possible  and  an  impossible  computation.  For  example,  if  r = 100  and 
each  of  the  variables  x^,  x^,  ....  xr  can  take  on  10  different  values, 
then  we  need  only  look  at  10  values  of  in  order  to  optimize  f^ , 10 

values  of  x^  in  order  to  optimize  f^,  and  so  on,  leading  in  total  of  1,000 
different  values  of  variables  x1 , x^,  ...,  xr>  This  is  a possible  task. 

If  F is  not  separable,  however,  we  must  look  at  all  of  the  101®0  different 
values.  This  is  an  impossible  task  even  on  a modern  high  speed  computer. 

Unfortunately,  the  problem  we  have  here  is  nonseparable.  Note  that 
the  number  of  aircraft  (N)  in  a squadron  is  a constant.  The  second  term 
of  E^X)  is  a nonseparable  function.  This  nonseparabil  ity  causes  the 
difficulty  in  computation  because  the  state  of  the  art  of  the  solution 
methods  to  this  problem  is  still  primitive. 

Another  property  pertaining  to  the  function  E^(X)  is  that  it  is 
monotonic  decreasing.  This  can  be  verified  easily.  Consider  the  differ- 
ence in  functional  value  when  xi  ( i = 1 , 2,  ...»  r)  increases  by  one  unit, 

E1(x1,x2,...,x.+l,...,xr)  - E1(x1,x2,...,xi,...,xr) 


lVV"V’  Q'(X'Wa<) 


(4) 


Since  q and  Q are  respectively  Poisson  probability  density  function 
and  cumulative  probability  function,  they  must  be  strictly  positive  unless 
q^O  or  QC'J-q^-  In  our  problem,  we  deal  with  a finite  number  of  n and  a. 
which  implies  that  both  q and  Q are  strictly  positive.  Therefore  equation 
(4)  is  strictly  negative,  and  the  function  is  monotonic  decreasing. 


Total  Expected  Number  of  Shortages 

Now  let  us  define  the  total  expected  shortages  for  all  items.  A 
shortage  occurs  whenever  the  number  of  demands  (or  failures)  exceeds  the 
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number  of  spares  in  the  kit.  The  total  number  of  demands  for  a squadron  of 
N aircraft  cannot  exceed  (Na.  + k4),  denoted  by  jm,„.  Then  by  definition 

1 1 mflX 

the  expected  number  of  shortages  for  item  i alone  is: 


'max 


j 


f(  “ j 4.+, (j<'x<)  \ 


U-.w-xj  n - 


max 

l q,  ] 


(5) 


i l 


v-° 


'1 


The  last  term  of  (5)  is  a correction  factor  for  the  tail  of  the 

it 

Poisson  distribution. 

Then  the  total  expected  number  of  shortages  for  all  items  can  be 
obtained  by  summing  (5)  over  i,  i.e., 

E?(X)  = T.  f. 
c i = l 1 


(6) 


Fortunately,  the  function  of  E^(X)  is  separable.  It  is  also  a mono- 
tonic decreasing  function,  since 
E2(X+e.)  - E2(X) 


'max 
F q.  < 0 
j=x.+l  J 


where  e^  = the  unit  vector  with  1 in  element  i. 


(7) 


An  alternative  method  of  treating  the  truncated  tail  is  to  normalize 
the  probabilities  by  dividing  the  first  term  by: 

Jmax 

l q.  . 
j^O  Ji 

Since  the  selection  of  the  correction  methods  is  not  the  primary  concern 
of  this  study  and  since  (5)  is  currently  being  used  in  D029  of  the  AF 
Logistics  Command,  we  shall  use  that  definition  henceforth. 


IV.  EXISTING  APPROACHES  AND  SOLUTION  ALGORITHMS 

In  this  section,  two  approaches  currently  in  use  for  the  determina- 
tion of  the  kit  composition  are  discussed.  Additionally,  a previously 
proposed  solution  algorithm  to  our  optimization  model  is  presented. 

Conventional  Method  [5] 

Traditionally,  the  kit  is  composed  of  the  essential  items  in  the 
amount  of  their  respective  mean  failure  rates  per  x number  of  flying  hours. 
This  is  rounded  to  the  nearest  integer  number  provided  that  every  item 
type  has  a minimum  of  one  unit  per  kit. 

The  advantage  of  this  method  is  its  simplicity  in  computation.  How- 
ever, the  kit  composition  thus  determined  may  be  far  from  the  optimum 
because  it  completely  ignores  the  requirements  of  meeting  acceptable  levels 
of  readiness  and  budgetary  limitations  in  allocation  of  the  spare  parts. 

Marginal  Analysis  [5] 

The  method  of  marginal  analysis  (or  incremental  analysis)  is  an 
iterative  procedure  consisting  of  the  following  basic  steps: 

1.  Begin  with  the  empty  kit  composition,  X°  = (0,0,. ..,0),  and  set 
v(X°)  = «. 

2.  At  iteration  t,  compute  the  change  in  performance  per  unit  cost 
for  all  i , 

v(Xt'1)  - v(Xt'1  + e.) 

A = L. 

i 

where 

v(Xs)  = at-  E-,  (Xs)  + E2(XS) 


(8) 

(9) 
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3.  Find  j = { i | max  A.},  and  compute: 

1-1.2 r 

= Xt_1  + e. 

J 

Z(Xfc)  = Z(Xt_1)  + Ci 

J 

4.  Increase  t by  1 and  repeat  steps  2 and  3 until  max  A^  is  equal 
to  0,  or  exceeds  the  prescribed  allowance. 

Conversely,  we  may  begin  with  a large  initial  kit  composition  and 
decrease  one  unit  at  a time  in  the  direction  of  minimizing  A^ , until  no 
reduction  is  possible.  Existing  kit  compositions  may  also  serve  as  a basis 
for  incremental  adjustment.  When  a large  initial  kit  surpasses  the  accept- 
able readiness  level,  the  decrement  version  of  the  method  is  used;  when 
the  kit  composition  falls  short,  the  increment  version  is  utilized. 

The  basic  method  of  marginal  analysis  and  its  variations  consider 
the  cost  of  a kit  as  well  as  the  improvement  of  the  readiness  by  both 
measures.  However,  different  initial  kits  will  result  in  different  final 
kit  compositions,  which,  in  turn,  vary  greatly  in  terms  of  cost  and  level 
of  readiness. 

Another  problem  of  the  method  is  in  the  selection  of  an  appropriate 
weight  (a)  for  formula  (9)  since  it  also  affects  the  final  solution. 
Empirical  computer  tests  [1]  of  different  combinations  of  the  initial  kits 
and  a-weightings  indicated  that  the  differences  in  final  kit  compositions 
were  very  significant. 

Original  Algorithm 

An  algorithm  was  proposed  by  the  author  in  his  previous  work  [1]  in 
an  attempt  to  find  an  optimum  kit  composition.  The  algorithm  utilizes  the 
computational  efficiency  of  marginal  analysis  to  determine  a good,  feasi- 
ble kit  by  trying  various  combinations  of  initial  kit  compositions  and 
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weights.  The  final  solution  thus  obtained  is  referred  to  as  a local  or 
relative  optimum  (denoted  by  X°)  since  X°  yields  total  cost  Z(X°)  < 

Z(X°+ei)  for  all  i while  subject  to  E^(X°)  < b-j  and  E2(X°)  < b^. 

The  implication  is  that  no  reduction  in  cost  is  possible  if  the  search 
is  continued  in  the  univariate  direction. 

In  an  attempt  to  further  improve  the  solution,  it  was  proposed  that 
a hyperplane  passing  through  X°  be  constructed  and  searched  for  another 
feasible  integer  point.  Finding  these  points  turns  out  to  be  a knapsack 
problem  [ 1 ].  If  a feasible  integer  point  is  found,  then  the  method  of 
marginal  analysis  is  again  applied  to  obtain  a new  local  optimum,  which  is 
at  least  as  good  as  the  previous  one.  If  no  feasible  integer  point  can  be 
found,  the  hyperplane  is  moved  in  a parallel  manner  by  reduction  of  cost. 
These  two  steps  are  alternately  repeated  until  the  amount  of  the  cost 
reduction  is  equal  to  or  less  than  max  c.j.  The  final  feasible  solution  is 
a global  (or  absolute)  optimum. 

Knapsack  Problem 

Mathematically,  finding  the  X integer  points  on  a hyperplane  is 

equivalent  to  finding  x.  = 0,1,2,..  which  solves 

E C.Xi  = Z*  (10) 

r 

where  Z*  is  the  current  local  minimum  cost  found  by  the  method  of  marginal 
analysis.  In  order  to  apply  the  existing  algorithms  for  this  knapsack 
problem,  an  objective  function  is  added:  Min  E c^.  The  algorithmic 
method  used  is  that  of  the  dynamic  programming  approach  [6,  7,  8,  9,  10]. 

Absolute  Lower  Bounds 

In  order  to  reduce  the  problem  size  of  (10),  a procedure  was  used  to 
establish  an  absolute  lower  bound  for  each  of  the  item  types. 
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Let  L-  be  a lower  bound  for  item  i.  Substituting  x-  = x^  - into 
(10),  we  obtain  the  following  transformed  equation, 

,1,  c'xi  ■ Z*  ’ 1 C<L<  ,n) 

Note  that  the  righthand  side  of  the  equation  (11)  is  reduced,  as  is  the 
problem  size. 

We  shall  now  show  how  the  absolute  lower  bound  , L^,  may  be  derived  from 
E-j(X)  <_  b^  and  E£(X)  £ b£. 

Consider  the  constraint  of  the  expected  number  of  NORS  aircraft, 

N-l  r 

E^X)  = N - E n q.  (x.  + na.)  < b]  (12) 

n i 

To  obtain  an  absolute  lower  bound  for  item  p,  we  let  all  other  items  be 
sufficiently  large  such  that  Q.fx^  + na.)  = 1 as  x^  = ® in  which  case,  we 
obtain  a reduced  constraint  involving  a single  variable  xp: 

N-l 

N - E Q (x  + na  ) < b,  (13) 

n=0  p p p 1 

Note  that  the  left-hand-side  function  is  monotonical ly  decreasing  in 
xp.  Finding  the  lower  bound  Lp  is  equivalent  to  finding  the  smallest 
value  of  p that  satisfies  (13).  Mathematically, 

N-l 

L'  = Min  {x  |N  - E Q (x  + na  ) < b, } (14) 

P P n=0  p P P i 

To  find  Lp  computationally,  we  may  begin  with  xp  = 0 and  increase 
Xp  by  one  unit  until  the  constraint  is  satisfied.  More  efficiently, 
the  interval  bisection  method  may  be  applied  when  the  value  of  Lp  is 
expected  to  be  large. 

Another  absolute  lower  bound  may  be  similarly  derived  from  the  con- 
straint of  total  expected  shortages  in  (5),  i.e. 
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x + Na 
P P 


j l , (VV  qp  * V' 'VW3  i b2 


Since  the  above  function  is  monotonical ly  decreasing  in  xp,  the  lower  bound 
Lp  may  be  calculated  by  finding  the  smallest  value  of  p,  i.e. 

XP  + Nap 

LP  * Wn  {Xp|  £ (Jp-*p)  Pp  - Nap-Q(xp*Nap)  « P2  - Nap) 

J»  ' V’  (,5) 

To  obtain  a higher  lower  bound  for  item  p (p  = l,2,...,r),  the 
larger  of  Lp  and  Lp  is  selected. 


Summary 

The  previous  algorithm  may  be  summarized  by  a flowchart  shown  in 
Figure  1.  The  input  datum  include  the  number  of  aircraft  in  a squadron 
(N),  the  unit  cost  ( c 1- ) , the  number  of  units  per  item  type  per  aircraft 
(a.)  and  the  mean  failure  rate  (X . ) for  all  item  i = l,2,...,r. 

Let  b^  and  b^  respectively  be  the  computed  values  of  the  expected 
NORS  aircraft  and  the  total  expected  shortages  of  the  composition,  deter- 
mined by  the  conventional  method.  These  values  will  be  treated  as  the 
acceptable  levels  defined  in  (1).  Attempts  are  made  to  find  a kit  composi- 
tion that  maintains  at  least  the  same  levels  of  b^  and  b^  yet  requires  a 
minimum  cost  investment. 

First,  an  absolute  lower  bound  for  each  item  i = l,2,...,r  is 
established  by  equations  (14)  and  (15). 

Then,  a kit  composition  is  determined  via  the  method  of  marginal 
analysis.  In  order  to  insure  a good  final  kit  composition,  many  differ- 
ent combinations  of  initial  kit  composition  and  various  relative  weights 
(a)  are  tested,  and  the  best  kit  composition  is  selected. 


/ for  i = l ,2 r f 


♦ 


Figure  1.  Flowchart  for  the  Original  Algorithm. 
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A knapsack  problem  is  then  constructed  to  generate  another  feasible 
integer  solution  or  point  on  the  same  hyperplane  (i.e.,  with  the  same  cost). 
If  such  a solution  is  located,  the  method  of  marginal  analysis  is  again 
tried  to  reduce  the  cost.  When  no  feasible  solutions  can  be  found  on  the 
current  hyperplane,  the  search  for  a feasible  point  is  continued  on  a less- 
cost  hyperplane.  The  procedure  is  repeated  until  the  total  cost  reduction 
exceeds  the  maximum  unit  cost  for  all  items,  denoted  by  max  c^.  Any 
search  for  a feasible  solution  below  the  cost,  Z°-max  c^,  is  unnecessary 
because  of  the  strictly  decreasing  property  of  the  constraint  functions 
and  the  strictly  increasing  property  of  the  cost  function. 

Previous  Computational  Results 

The  algorithm  was  programmed  and  tested  on  Honeywell  6000/600  computer 
at  Wright-Patterson  AFB,  and  later  on  UNI VAC-1 110  at  The  University  of 
Alabama.  The  computational  results  showed  that  the  requirements  of  com- 
puter memory  and  computation  time  increased  exponentially  as  the  number 
of  item  types  increased.  For  instance,  the  computation  time  for  solving  a 
kit  composed  of  10  different  item  types  took  about  20  minutes  in  UNI VAC-1 110. 
A problem  of  11  different  items,  required  about  45  minutes.  For  a larger 
problem  size,  the  optimum  solution  cannot  be  found  in  a reasonable  amount 
of  computer  time. 


V.  REVISED  ALGORITHM 


In  this  section,  the  weakness  of  the  original  algorithm  will  be 
identified  and  improved.  The  improvements  include  selection  of  a good 
initial  kit  composition,  improvements  in  convergence  toward  a global 
optimum,  and  refinements  in  programming  techniques. 

I nit i a 1 Kit  Compos i t i on 

In  order  to  obtain  a "good"  starting  kit  composition,  the  original 
algorithm  applied  the  method  of  marginal  analysis  to  different  combina- 
tions of  the  initial  kit  composition  and  weighting.  This  procedure  not 
only  caused  computational  ineffectiveness  but  also  obtained  an  unpre- 
dictable result.  The  revised  algorithm  utilizes  the  kit  composition 
determined  by  the  conventional  method  to  serve  as  a starting  point.  In 
fact,  empirical  tests  show  that  this  kit  composition,  on  many  occasions, 
is  better  than  local  minima  found  by  marginal  analysis. 

Univari ate  Sea rch 

In  an  attempt  to  find  a local  minimum,  the  original  algorithm  steers 

the  search  at  each  iteration  in  a univariate  direction  (via  marginal 

analysis)  that  maximizes  the  incremental  gain  in  the  combined  performance 

per  unit  cost.  Although  these  moves  can  finally  lead  to  a feasible 

solution,  it  may  however  be  far  from  the  optimum. 

Instead  of  using  marginal  analysis,  the  revised  algorithm  reduces 

the  cost  within  the  feasible  region  by  moving  in  a univariate  direction 

k k+1 

that  yields  the  greatest  unit  reduction.  Let  X and  X be  the  feasible 
kit  composition  in  two  successive  iterations  k and  k+1.  Their  relation- 
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where: 

j = {i|max  c^,  E^(Xk+1)  < and  E2(Xk+1)  < b^}  (16) 

Search  Region 

The  greatest  weakness  of  the  original  algorithm  is  in  the  searching 
for  a feasible  integer  point  after  a local  optimum  has  been  found.  If  no 
feasible  point  is  found,  the  searching  must  be  continued  on  a family  of 
parallel  hyperplanes.  Since  the  number  of  integer  points  on  these  hyper- 
planes may  be  astronomical,  examination  of  them  is  computationally  intracta- 
ble, if  not  impossible,  even  if  the  dynamic  Drogramming  approach  is  utilized. 
In  order  to  circumvent  this  problem,  two  remedial  actions  are  taken: 

(1)  narrow  down  the  cost  range  to  be  searched  from  max  c^  to  min  c^ ; and 

(2)  restrict  the  integer  points  to  be  searched  to  those  delimited  by  the 
upper  and  lower  bounds  for  each  x^  and  the  constraints  of  (6)  and  (12). 
Hopefully,  a large  subset  of  infeasible  points  (or  ungainful  points)  will 
be  eliminated  from  examination.  In  what  follows,  we  shall  validate  that 
the  search  is  sufficient  within  the  cost  range  of  min  c^. 

Theorem:  Let  E-j(X)  and  E2(X)  be  monotonic  decreasing  functions  and 
Z(X)  = CX  a monotonic  increasing  function  in  X,  where  C = (c^ ,c2>. . . ,c . , . . .cp) 
and  c.j  > 0 for  all  i.  Also  let  X-j  be  a feasible  solution  to  problem  (1), 
i .e. , 

X1  e S = {X  | (E1(X)  < b-j ) 0 (E2(X)  < b2)} 

with  cost  Z(X^)  = CX^ . If  there  exists  X3  e S with  Z(X3)  = CX3  < Z ( X-j ) , 
then  at  least  one  XeS,  say  X2,  can  be  found  in  the  interval 
CZ(X1)  - Ck,  Z(X1)), 


where 
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Proof:  There  are  hut  two  cases  of  X^  t S: 

(1)  7 ( X 1 ) - ck  < Z(X,)  < Z(X, ) and 

(2)  Z(X3)  v Z(X})  - ck  v Z(X,) 

Obviously,  th.  theon  i Isolds  for  case  (1)  if  we  let  X^  = X^.  For  case  (2), 
we  prove  the  theorem  hv  contradiction. 

Assume  t $ with  Z(X^)  < Z(X^)-c~k  and  there  exists  no  feasible 
solution  in  the  interval,  [Z(xp  - c^,  Z(X^)).  Let  ek  be  a unit  vector 

associate  with  c.  . Then  we  can  always  find  an  integer  m * 1 , 2 such 

that  (X^  + tne^)  t S with  Z(X?  + me,J  < Z ( X-j ) and  Z ( X + (m+l)ek)  > Z ( X1 ) 
since  E-|(X)  and  C^(X)  are  monotonic  decreasing  functions  and  Z(X)  is  a mono- 
tonic increasing  function. 

Since  Z(X,  + (in*-l)ek)  = Z(X^  + me^)  + c^,  it  follows  Z(X^  + me^)  > 
Z(X^)  - c^.  By  letting  X^,  = X,  + me^,  we  have  a feasible  solution  X£  t S 
found  in  an  open  interval  (Z(Xj)  - c^,  Z(X^)),  a subinterval  of 
[Z(X1)  - c(  , Z ( X ^ ) ) , which  contradicts  our  assumption.  O.E.D. 

One  application  of  this  theorem  is  that  if  we  cannot  find  a feasible 
solution  in  the  interval  [ Z ( X ^ ) - min  c^,  Z(X^)),  then  no  better  feasible 
solution  can  be  found  and  therefore  the  current  local  optimum  is  also  a 
global  optimum. 

Branch- And- Bound  Technique 

We  shall  now  develop  a systematic  scheme  that  can  search  for  a 
feasible  integer  solution,  if  one  exists,  in  the  interval  of  [7(X.j)  - c(  , 
Z(X^)).  An  integer  point  is  feasible  if  it  lies  within  the  region 
delimited  by  this  interval,  and  is  subject  to  the  constraints  of 
E^(X)  ■ bj  and  E,(X)  v b,  in  addition  to  the  upper  and  lower  bounds  for 


all  variables. 
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A lower  bound  (Lp)  for  x^  can  be  determined  by  expression  (14)  and 
(15).  A upper  bound  (U^)  for  Xp  may  be  derived  from  the  inequality: 

Ic1xi  < 2(X1),  i.e. 

U - [(Z(X,)  - I Li  x.}/c  ] (17) 

r i=p  H 

where  [w]  = greatest  integer  less  than  or  equal  to  w. 

Another  upper  bound  for  xp  also  may  be  derived  from  the  property  of 

the  Poisson  distribution  embedded  in  E^X)  and  E2(X).  This  derivation  will 

be  given  in  a later  section. 

The  decision  variable  x^  can  take  on  the  following  integer  values: 

Lj+1,  L.j+2,  ....  U^.  If  we  let  y.  = x^  - , then  y^  can  take  on  only 

the  values:  0, 1 ,2, . . . , (IK -L^ ) . For  ease  of  computation,  from  now  on,  we 
shall  deal  with  the  variable  y..  instead  of  x^ . 

Mathematically,  we  must  find  a Y = (y.j ,y2* • • • »y^ » ■ • • »y  ) that  satisfies 
the  following  constraints: 


z,  £ 2 C,y,  £ Z0 


08) 


where 


0 £ y.j  £ U.j  - L.j  for  all  i 
Ej(Y+L)  < bj  j-1,2 

L - ( L-|  ,1-2 « • • . »L^. , . . . ,Lj.) 

zo  = Z<V  - £ S-Li 

= Zq  - min  c.. 

The  feasible  solution  space  of  the  above  problem  can  be  represented 
by  a tree  where  the  starting  node  is  associated  with  all  variables  set 
equal  to  0.  From  this  node,  a branch  is  generated  for  each  value  of  y^  in 
the  interval  of  [0,  ] . Then,  from  each  of  these  nodes,  all  integer 

values  in  [0,  IF  - L .]  of  y2  branch  out.  The  same  procedure  is  repeated 
for  y3,  y4,  ....  y 


. 
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Numerical  Example 

Consider  the  following  problem: 


1669 

< 493y]  + 873y2 

+ 490y3  + 103y4  < 1672  --  (A) 

1 

e2(y 

+ L ) < b2  -- 

(B) 

¥Y 

+ L ) < b, 

(C) 

(19)  ! 

>i  = 

0 or  1 

(D) 

*2  = 

0 or  1 

(E) 

1 

y3  = 

0,  1 or  2 

(F) 

1 

y4  = 

0,1 ,2  or  3 

(G) 

A solution  tree  representing  (19D)  through  (19G)  is  given  in  Figure  2. 
This  tree  will  be  used  later  for  describing  our  search  strategy. 

A path  from  the  origin  node  to  a terminal  node  represents  an  integer 
solution  which  may  be  feasible  or  infeasible.  The  tree  includes  all 
possible  integer  solutions.  Since  this  total  enumeration  is  computationally 
intractable  even  for  a small  number  of  variables,  we  shall  present  a branch- 
and-bound  technique  that  will  systematical ly  examine  only  a small  subset 
of  the  tree. 

We  shall  use  the  upper  and  lower  bounds  in  (19A)  to  be  bounds  on  a 
node  and  use  the  constraint  of  expected  shortage  in  (19B)  to  be  a criterion 
for  determining  the  order  of  branching.  Any  subtrees  that  may  branch  from 
this  node  will  be  dropped  from  consideration.  Because  the  computational 
efforts  involved  in  constraint  (19C)  are  considerable,  it  will  not  serve  as 
a bounding  constraint  and  will  be  checked  for  feasibility  only  after  a 
complete  solution  is  obtained. 

The  first  bounding  constraint  is  the  upper  bound  for  the  current 
cost,  Zg  = 1672.  Any  subtree  which  has  a minimum  cost,  T^(t),  greater 
than  Zg  will  not  be  generated.  The  value  of  T^(t)  for  node  t is  defined  as 
follows. 
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At  node  t,  some  variables  are  specified  and  some  variables  are  un- 
specified or  free.  At  node  7,  for  example,  the  specified  variables  are 
y^  and  and  the  free  variables  are  y^  and  y^.  The  minimum  cost  for  the 
subtree  branching  from  node  7 is  obtained  by  setting  the  free  variables 
equal  to  0 because  the  total  cost  is  always  nondecreasing  as  a variable 
is  added.  This  minimum  cost  is  denoted  by  T^(t)  for  node  t.  For  example, 
consider  Figure  3 with  T^(t)  on  nodes.  Nodes  18  and  19  can  be  eliminated 
because  they  exceed  Zq  = 1672. 

The  second  bounding  constraint  is  the  lower  bound  for  the  current 
cost,  Z.j  = 1669.  Any  subtree  branching  from  node  t which  has  a maximum 
cost,  denoted  by  T,,(t),  less  than  Z^  will  be  cut  off.  The  T2 ( t ) is  defined 
by  setting  the  free  variables  equal  to  their  upper  bounds  (U^).  Figure  4 
shows  the  subtrees  to  be  cut  off  due  to  this  bound. 

i 

We  shall  now  discuss  how  to  determine  the  node  to  be  generated  first. 
In  tree  expansion,  we  start  out  with  node  1 and  expand  it  to  generate  its 
successors,  nodes  2 and  3.  The  problem  is:  which  node  should  be  considered 
such  that  a solution  in  the  subtree  generated  from  that  node  will  be  more 
likely  to  be  feasible.  In  order  to  attain  this,  an  evaluation  function 
[11]  defined  by  E2(Y"  + L)  will  be  used  to  estimate  the  best  expected 
shortages  for  a given  node  or  subtree.  In  other  words,  the  evaluation 
function  is  used  to  provide  a means  for  ranking  those  nodes  that  are  can- 
didates for  expansion  to  determine  which  one  is  most  likely  to  bo  the  best 
path  to  a feasible  solution.  The  nodes  with  the  smallest  functional  value 
will  be  branched  first  because  the  lower  the  value,  the  higher  the 
potential  to  attain  a feasible  solution.  Once  a node  has  been  selected, 
the  founding  costs  associated  with  the  node  are  computed  and  the  node  is 
checked  for  the  possibility  of  elimination. 


T,(2)*0 

/ 

Ti 

Figure 


3)  T1  (3)=493 


T1(7)=1366 

\ 

T1  (1 7)  = 1366  (V7)  (|8)  (J9)  T2(19)=2346 

\,T1  ( 18)  = 1856 


3.  Subtrees  Eliminated  by  Upper  Bound  ZQ. 


Figure  4.  Subtrees  Eliminated  by  Lower  Bound  Z, . 
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In  a step-by-step  fashion,  with  the  aid  of  Figure  5,  we  shall  solve 
problem  (19)  in  which  bj  = 1.715,  b^  = 1.016  and  objective  function: 
minimize  Z = 493y^  + 873y2  + 490y^  + 103y^. 

Step  1 : Set  up  the  root.  A,  and  compute  associated  bounding  costs 
and  E2< 

Y ' ( A)  = (0,0, 0,0),  T^(A)  * 0 (lower  bound  for  A) 

Y"(A)  = (1,1, 2,3),  T2(A)  = 2655  (upper  bound  for  A) 

E2  - (1, 1,2,3)  » 0 

Step  2:  Select  the  node  with  min  E2(Y")  and  expand  this  node.  Doing 
so,  we  obtain  nodes  B and  C: 

Y'(B)  = (0,0, 0,0),  T i ( B ) = 0 
Y" (B)  = (0,1, 2, 3),  T2(B)  = 2162 
E2 (0,1 ,2,3)  = 0.17 
Y * ( C ) = (1,0, 0,0),  T,(C)  = 493 
Y" (C)  = (1,1,2, 3),  T2(C)  = 2655 
E2(l,  1,2,3)  = 0 


Step  3:  Check  for  a cut-off  node.  No  cut-off  node  so  far. 

Step  4:  Repeat  steps  2 and  3 to  generate  nodes  D through  I until 
a complete  solution  is  obtained.  Nodes  D,  G and  H are  eliminated  as  cut- 
off nodes.  Note  that  at  the  last  level,  y^  is  determined  by  the  expression: 


y4 


- t 


(F) 

] 


Since  y^  = 0,  only  one  successor  is  expanded  at  the  last  level. 

Step  5:  Check  the  complete  solution  (1,1, 0,0)  against  the  con- 
straint of  Ej  for  feasibility. 


I 
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Should  E.j(l,l,0,0)  < 1.715,  then  we  have  found  a feasible  solution 
and  we  return  to  the  univariate  search.  Otherwise  node  I is  eliminated 
and  node  B will  be  expanded  next. 

Two  possible  cases  may  occur  during  the  process  of  branching  and 
bounding:  (1)  No  feasible  solution  can  be  found,  and  all  nodes  are  either 
cut-off  for  violating  constraints  (19A,  B,  D,  E,  F and  G)  or  eliminated 
due  to  violation  of  constraint  (19C);  or,  (2)  A feasible  solution  will  be 
found. 

In  case  (1),  the  current  local  optimum  is  a global  optimum.  In  case 
(2),  the  univariate  search  is  applied  again  to  obtain  a new  local  optimum 
and  to  calculate  a new  upper  bound  for  each  variable,  Up. 

Since  Zq  is  always  decreasing,  this  new  upper  bound  will  be  lower 
than  the  previous  upper  bounds.  Since  the  lower  bound  (L.. ) used  in  our 
algorithm  is  an  absolute  lower  bound  as  required  by  satisfying  the 
acceptable  levels  b-j  and  b^ , it  should  remain  unchanged  for  all  Zq. 
Therefore,  the  reduction  of  the  upper  bound  causes  the  algorithm  to 
converge. 

Note  that  when  a new  local  optimum  is  obtained,  the  nodes  that  have 
been  cut-off  due  to  T^(t)  > ZQ  or  E-|  > b1 , cannot  be  candidates  for 
feasible  solutions  because  they  violate  the  old  Zq  which  implies  violation 
of  the  new  Zq. 

If  T2 ( t ) < Z^ , the  node  t may  become  feasible  for  a new  Z^ . If  it 
does,  the  node  should  be  restored  to  the  tree  for  future  expansion. 
Therefore,  we  do  not  have  to  start  an  entirely  new  tree,  but  rather 
continue  on  our  tree  expansion  from  those  nodes  still  remaining. 


A flowchart  in  Figure  6 summarizes  the  procedure  for  the  revised 
algorithm.  It  is  self-explanatory,  we  shall  not  reiterate. 
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Figure  6.  continued 
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VI.  NUMERICAL  RESULTS  AND  CONCLUSIONS 


The  revised  algorithm  was  programmed  in  ASCII  FORTRAN  and  tested  on 
a UNIVAC-1 110  computer  at  The  University  of  Alabama.  In  addition  to  re- 
porting the  computational  results,  some  practical  considerations  for 
implementation  are  recommended.  Conclusions  concerning  this  research 
will  follow. 

Test  Data 

The  data  used  in  this  test  was  obtained  from  the  first  17  line  items 
of  the  field  data  collected  at  an  F-14  base  [2].  These  data  items  are 
summarized  in  Table  1 . 

Computational  Results 

The  computational  times  for  the  revised  algorithm  versus  the  original 
algorithm  are  reported  in  columns  2 and  3 of  Table  2.  The  revised  algorithm 
improves  the  efficiency  in  computation.  Note  that  the  spares  kit  is 
allowed  to  stock  zero  units  of  "essential"  parts  which  have  an  exceptionally 
low  failure  rate. 


Practical  Considerations  for  Implementation 

Two  of  the  many  means  of  enhancing  the  solvability  of  the  revised 
algorithm  that  we  should  consider  are:  the  characteristics  of  the  data 
and  the  properties  of  the  constraint  functions  E^(X)  and  E2 ( X ) . 

Since  the  number  of  failures  for  an  item  follows  a Poisson  distri- 
bution, theoretically  the  number  of  failures  can  take  on  values  from  0 to  00 
if  all  possibilities  are  considered.  Practically,  however,  we  may  be 
content  with  a 95%  or  99%  reliability  for  an  item. 
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Table  1 
Item  Data 


Item  No.  No.  of  Units  Unit  Cost  ($) 
I A( I)  C(I) 


1 

1 

1206 

2 

1 

8116 

3 

1 

1041 

4 

1 

185 

5 

1 

248 

6 

1 

165 

7 

1 

1141 

8 

1 

313 

9 

1 

944 

10 

1 

1813 

11 

1 

2555 

12 

1 

363 

13 

1 

2416 

14 

1 

309 

15 

1 

990 

16 

1 

6101 

17 

1 

493 

Mean  Failure  Rate 
per  1800  flying  hours 
X(I) 


0.1224 

0.2322 

0.2538 

0.0270 

0.5508 

0.6570 

0.7686 

0.1062 

0.7038 

0.3636 

2.5758 

0.8748 

2.1348 

0.3762 

0.2556 

0.8334 

0.1062 
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Table  2 


Computation  Time 
(CPU  in  seconds) 


(1) 

No.  of  Line  Items 
In  the  Kit 

(2) 

Original 

A1 gori thm 

(3) 

Revised  Algorithm 
(an  item  may  take 
on  0 unit) 

(4) 

Revised  Algorithm 
(at  least  1 unit) 
Per  Item  Type 

5 

0.059 

0.094 

0.057 

6 

0.056 

0.100 

0.081 

7 

0.138 

0.235 

0.195 

8 

0.278 

0.396 

0.329 

9 

0.401 

0.602 

0.379 

10 

1132.448 

1.161 

0.647 

11 

-- 

2.446 

1 .055 

12 

-- 

3.382 

1 .160 

13 

-- 

5.163 

1.210 

14 

-- 

7.145 

1 .261 

15 

-- 

10.359 

1.316 

16 

-- 

25.508 

1.701 

17 

-- 

77.479 

1.755 

33 


I 


In  the  light  of  this  idea,  we  may  obtain  a better  upper  bound,  especially 
for  a small  random  variable. 

Finding  an  upper  bound  U for  X is  equivalent  to  finding  the  smallest 
j*  such  that 

^ j* 

Z q.  > 0.95  (20) 

j=0  J 

: 

where  q.  is  a Poisson  density  function.  Rearranging  (20),  we  obtain  a 

J 

simple  expression: 

j*  J 

Z ji-  > 0.95  e'X  - 1 (21) 

j = l J- 

Similarly,  the  concept  of  95%  reliability  may  be  utilized  to  increase 
the  lower  bound  via  equation  (14),  which  in  turn  can  speed  up  the  con- 
vergence of  the  algorithm. 

In  the  case  where  a minimum  of  one  unit  per  item  is  imposed  on  every 
line  item,  the  revised  algorithm  solves  the  problem  with  a substantial 
reduction  of  time.  This  can  be  seen  in  column  (4)  of  Table  2.  The  reduc- 
tion of  computation  time  is  due  to  the  low  failure  rates  for  most  items, 
which  in  turn  cause  the  lower  bound  to  be  equal  to  the  upper  bound.  The 
restriction  of  at  least  one  unit  per  item,  however,  greatly  increases  the 
total  cost  of  a kit  composition  as  is  shown  in  Table  3. 

By  observing  the  kit  composition  table  of  238  items,  we  find  that 
many  items  have  approximately  the  same  unit  cost,  mean  failure  rate  and 
number  of  units  per  item.  These  items  may  be  grouped  and  treated  as  one 
type.  As  a result,  the  revised  algorithm  can  solve  a much  larger  problem 
size. 
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Table  3 

Comparisons  of  Total  Costs 
Revised  Algorithm 


Lower  Bound 

Lower  Bound 

Best  Local  Optimum 

Items 

Determined  by 

Must 

be  at  Least 

Prior 

to  Tree 

Goals  b-|  & b2 

One  Unit  Per  Item 

Search 

5 

I*=$7969 

I 

= 

7969 

I = 

7969 

F*=  7390 

F 

= 

7969 

F = 

7390 

6 

I = 8451 

I 

= 

8451 

I = 

8451 

F = 7603 

F 

= 

8451 

F = 

7844 

7 

I = 9108 

I 

= 

9108 

I = 

9108 

F = 6160 

F 

= 

6811 

F = 

8097 

8 

I = 9289 

I 

= 

9289 

I = 

9289 

F = 6122 

F 

= 

7209 

F = 

6122 

Q 

I = 9409 

I 

= 

9409 

I = 

9409 

F = 6242 

F 

= 

7329 

F = 

6242 

10 

I = 11461 

I 

= 

11461 

I = 

11461 

F = 7980 

F 

9059 

F = 

10212 

11 

I = 11575 

I 

= 

11575 

I = 

11575 

F = 8071 

F 

= 

9378 

F = 

10259 

12 

I = 11679 

I 

= 

11679 

I = 

11679 

F = 8175 

F 

= 

9482 

F = 

10363 

13 

I = 12669 

I 

= 

12669 

I = 

12669 

F = 8169 

F 

= 

10472 

F = 

10467 

14 

I = 13613 

I 

= 

13613 

I = 

13613 

F = 8645 

F 

= 

11211 

F = 

11063 

15 

I = 14106 

I 

= 

14106 

I = 

14106 

F = 8622 

F 

= 

11704 

F = 

10889 

16 

I = 14596 

I 

= 

14596 

I = 

14596 

F = 9112 

F 

2 

12353 

F = 

11379 

17 

I = 14909 

I 

= 

14909 

I = 

14909 

F = 9248 

F 

= 

12666 

F = 

11471 

I*  = 

Total  cost  for  the 

initial 

kit  composition. 

F*  = 

Total  cost  for  the 

final  kit  composition. 

i 
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Conclusions 

The  following  conclusions  are  drawn  from  this  study: 

1.  Any  feasible  solution  to  the  constructed  optimization  model  can 
yield  a lower  cost  investment  than  does  the  conventional  kit 
composition  while  maintaining  at  least  the  same  levels  of 

( support  for  war  readiness. 

2.  The  revised  algorithm  does  improve  significantly  the  computation 
time  for  determining  an  optimum  kit  composition,  though  it  can 
only  be  applied  to  a limited  number  cf  line  items. 

3.  With  the  imposition  of  a minimum  of  one  unit  per  item,  the 
revised  algorithm  can  solve  a larger  sized  problem  with  much 
less  computation  time. 

4.  Should  a global  optimum  not  be  mandated,  the  revised  algorithm 
can  solve  an  even  larger  problem  for  a relatively  good 
solution. 

5.  Grouping  of  similar  items  into  a single  type  classification  is 
another  strategy  to  help  solve  the  problem  of  large  size. 


VII. 
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THE  UNIVERSITY  OF  ALABAMA 
COLLEGE  OF  ENGINEERING 

The  College  of  Engineering  of  The  University  of  Alabama  (Tuscaloosa)  has  an 
undergraduate  enrollment  of  more  than  1,000  students  and  a graduate  enrollment  ot 
90  100.  There  are  approximately  100  faculty  members,  a significant  number  of  whom  con 
duct  research  in  addition  to  teaching. 

Research  is  an  integral  part  of  the  educational  program,  and  interests  parallel  academic 
specialities.  It  is  conducted  in  the  classical  engineering  programs  of  aerospace,  chemical, 
civil,  electrical,  engineering  hydrology,  engineering  mechanics,  environmental,  industrial, 
mechanical,  metallurgical,  and  mineral  engineering.  All  of  these  programs  offer  the 
master's  degree,  and  five  programs  offer  the  educational  specialist  and  doctor  of 
philosophy  degrees 

Other  organizations  on  the  University  campus  that  contribute  to  particular  research 
needs  of  the  College  ot  Engineering  are  the  Charles  L.  Seebeck  Computer  Center, 
Geological  Survey  of  Alabama,  Marine  Environmental  Sciences  Consortium,  Mineral 
Resources  Institute— State  Mine  Experiment  Station,  Natural  Resources  Center,  U S 
Bureau  of  Mines,  Tuscaloosa  Metallurgy  Research  Center,  and  the  Research  Grants  Com 
mittee 

This  University  community  provides  opportunities  for  interdisciplinary  work  in  pursuit  of 
the  basic  goals  of  teaching,  research,  and  public  service 


